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Evaluating multiple performance factors among system design

alternatives requires a coherent methodological framework.

Multidimensional value theory meets that need.

Designing a system architecture is often the
initial stage in any system development and
can be the most critical one. During the architec-
tural design phase, analysts examine many impor-
tant configurational alternatives and eventually
discard all but one. Each potential configuration
has unique strengths and weaknesses, and the deci-
sion process involved must deal with all the diverse
facets of system effectiveness and cost. Decision
analysis, in particular multidimensional value
theory, offers an approach that is not only ade-
quate to the complexities of the process but one
that yields a number of other advantages as well.

Decision analysis gives system designers a struc-
tured, logical, analytical methodology for
evaluating alternative architectural configurations.
Multidimensional value theory, developed as part
of a program sponsored by the Defense Advanced
Research Projects Agency, provides a basis for
subdividing effectiveness and cost, which comprise
the bottom line, into their component parts. The
system design team can subdivide these component
parts as finely as necessary to allow individual team
members to focus their expertise, in turn, on spe-
cific issues. Synthesis of the results yields an end
product that decision-makers can use with con-
fidence.

Among the benefits of this approach are in-
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creased objectivity, less risk of overlooking signifi-
cant factors, and perhaps most important, the
ability to reconstruct the selection process rather
than invoking intuition in explaining the configura-
tion selected. A distinct advantage of decision
analysis over cost-effectiveness, the traditional
methodology, is that the former does not require
absolute, all-encompassing judgments concerning
the relative importance of the various effectiveness
factors; assignment of weighted values is much less
subjective. Decision analysis provides a pragmatic,
problem-specific interpretation for such judg-
ments, as the example that follows will demon-
strate. Because the results are quantitative,
evaluators can conduct sensitivity and "what if"
analyses at an early stage in system design to deter-
mine the robustness of the results and to identify
key factors that can affect the results.

The application of multidimensional value
theory discussed below highlights key features of
the methodology. The project involved design of
the Worldwide Digital System Architecture, a com-
prehensive architecture that will guide development
of all future Defense Department common-user
telecommunications systems. Over a five-month
period, a decision analysis team evaluated alter-
native architectures in three, successively more
detailed phases. They considered a wide range of
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